A Modified Regression Algorithm for Fast One Layer Neural Network Training
نویسندگان
چکیده
ABSTRACT Difficulties and limitations of the LMS (regression) algorithm are discussed. Although regression algorithms and minimum distance classifiers are very fast, they usually converge to the wrong solution. The proposed modified regression algorithm produces the same results as the delta (back propagation) algorithm, however, it only requires two to three iterations versus the 10,000 iterations required by the delta algorithm. This translates to a savings of a factor of 1,000 less floating point operations. Simple two dimensional illustrative examples are also presented.
منابع مشابه
Wavelet Neural Network with Random Wavelet Function Parameters
The training algorithm of Wavelet Neural Networks (WNN) is a bottleneck which impacts on the accuracy of the final WNN model. Several methods have been proposed for training the WNNs. From the perspective of our research, most of these algorithms are iterative and need to adjust all the parameters of WNN. This paper proposes a one-step learning method which changes the weights between hidden la...
متن کاملHandwritten Character Recognition using Modified Gradient Descent Technique of Neural Networks and Representation of Conjugate Descent for Training Patterns
The purpose of this study is to analyze the performance of Back propagation algorithm with changing training patterns and the second momentum term in feed forward neural networks. This analysis is conducted on 250 different words of three small letters from the English alphabet. These words are presented to two vertical segmentation programs which are designed in MATLAB and based on portions (1...
متن کاملUsing Artificial Neural Network Modeling in Predicting the Amount of Methyl Violet Dye Absorption by Modified Palm Fiber
Bio-absorbent palm fiber was applied for removal of cationic violet methyl dye from water solution. For this purpose, a solid phase extraction method combined with the artificial neural network (ANN) was used for preconcentration and determination of removal level of violet methyl dye. This method is influenced by factors such as pH, the contact time, the rotation speed, and the adsorbent dosag...
متن کاملThe Predictability Power of Neural Network and Genetic Algorithm from Fiems’ Financial crisis
Organizations expose to financial risk that can lead to bankruptcy and loss of business is increased nowadays. This may leads to discontinuity in operations, increased legal fees, administrative costs and other indirect costs. Accordingly, the purpose of this study was to predict the financial crisis of Tehran Stock Exchange using neural network and genetic algorithm. This research is descripti...
متن کاملFast Voltage and Power Flow Contingency Ranking Using Enhanced Radial Basis Function Neural Network
Deregulation of power system in recent years has changed static security assessment to the major concerns for which fast and accurate evaluation methodology is needed. Contingencies related to voltage violations and power line overloading have been responsible for power system collapse. This paper presents an enhanced radial basis function neural network (RBFNN) approach for on-line ranking of ...
متن کامل